Papers with Argument Reasoning Comprehension Task
Probing Neural Network Comprehension of Natural Language Arguments (P19-1)
Copied to clipboard
| Challenge: | Argument Reasoning Comprehension Task (ARCT) focuses on inferences, not just discovering warrants. |
| Approach: | They propose to build an adversarial dataset on which all models achieve random accuracy. |
| Outcome: | The proposed dataset provides a more robust assessment of argument comprehension and should be adopted as the standard in future work. |
Reproduction and Revival of the Argument Reasoning Comprehension Task (2020.lrec-1)
Copied to clipboard
| Challenge: | Reproduction of scientific results is essential for scientific development across all disciplines. |
| Approach: | They evaluate scientific reproduction of arguments reasoning comprehension systems . they find reproducing results of previous work is a basic requirement for validating hypothesis . |
| Outcome: | The proposed systems were compared with the revised data set and scored in line with the results of the argument reasoning comprehension task. |